Cliff Tokens: Identifying Single-Token Failure Triggers in LLM Mathematical Reasoning

Large language models (LLMs) reach high accuracy in mathematical reasoning, but individual traces on the same problem diverge; some arrive at the correct answer while others fail. Prior work analyzes failure at the step, chunk, or sentence level, or at tokens where failure has already occurred. Neit…

View Post on Scour ↗

More from arXiv on Scour.

Rate this post to improve your feed:
🌰 Love 👍 Like 👎 Not for me